ADA055009 


Tvchnieol  Kapert  Decum«ntatiii.«i  Pog* 


3.  R»eipi0nt’  § Catalog  No. 


FAA~AM-78 


JHE  RELATIONSHIP  OF  PREDEVELOPMENTAL  "iSO*  pAININ(^ 
WITH  JIONCOMPETITIVEL?  SELECTED  AIR  TRAFFIC  CONTROL 
TRAINEES  TO  EAA  ACADEMY  SUCCESS, 


James  py Boone  

rming  Orgoni lotion  Nomo  ond  Addiott 

FAA  Civil  Aeromedical  Institute 
P.O.  Box  25082 

Oklahoma  City,  Oklahoma  73125 


10.  Work  Unit  No.  (TRAIS) 


1 1 . Controct  or  Grant 


12.  Sponsoring  Agoncy  Nomo  ond  Addross 

Office  of  Aviation  Medicine 
Federal  Aviation  Administration 
800  Independence  Avenue,  S.W. 
Washington,  D.C.  20591 


15.  Supplomontory  Notos 


Work  was  performed  under  Tasks  AM-C-77-PSY-70  and  AM-C-78-PSY-70 


16.  Abstroet 

Past  studies  have  demonstrated  that  womei^  and  minorities  are  less  likely  to  be 
selected  as  FAA  air  traffic  controllers  than  are  nonminority  men,  and,  when 
selected,  are  less  likely  to  be  successful.  One  major  reason  for  this  is  that  women 
and  minorities  have  less  aviation-related  background  experience.  In  response  to 
this  need  the  *150*  Predevelopn«ntal  program  was  begun  to  give  those  selected  for 
the  program  a 1-year  orientation  to  aviation  and  air  traffic  control  prior  to  FAA 
Academy  training.  The  purpose  of  this  research  was  to  study  the  unique  relationship 
between  Predevelopmental  training  and  Academy  success.  An  overview  of  the  relation- 
ships between  various  background  characteristics,  selection  measures,  Predevelop- 
mental training  measures,  and  Academy  measures  was  first  computed.  Then,  through 
path  analysis  the  significant  relationships  were  considered  simultaneously  to  deter- 
mine the  unique  relationship  between  Predevelopmental  training  and  Academy  success. 
The  path  models  indicated  that  Predevelopmental  training  overall  does  enhance  a 
trainee's  potential  for  Academy  success  with  a possible  differential  effect 
according  to  minority  status. 


17.  Koy  Words 

Training 

Air  Traffic  Controller 
Assessment 


18.  Distribution  Stotomont 


Document  is  available  to  the  public 
through  the  National  Technical  Information 
Service,  Springfield,  Virginia  22161 


If.  Security  Cle.til.  (af  ihl.  rcyorO 


Unclassified 


Rtpreduetlofl  of  completed  pege  outherlied 


20.  Socurity  Clossif,  (of  this  |»«g*) 

21*  No.  of  Pogos 

Unclassified 

23 

THE  RELATIONSHIP  OF  PREDEVELOPMENTAL  "150"  TRAINING  WITH  NONCOMPETITIVELY 
SELECTED  AIR  TRAFFIC  CONTROL  TRAINEES  TO  FAA  ACAMIMY  SUCCESS 

I . Introduction. 

Several  past  studies  have  indicated  that  prior  air  traffic  control  (ATC) 
experience  (usually  from  military  service)  is  strongly  related  to  being 
selected  for  ATC  training  in  the  Federal  Aviation  Administration  (FAA)  and  to 
later  success  in  FAA  ATC  training  (2,3,10).  It  was  also  noted  in  these 
studies  thst  women  who  are  selected  for  training  have  significantly  less  prior 
ATC  experience  than  do  men  (1).  More  recent  unpublished  reports  (6)  demon- 
strate that  minorities  are  also  less  apt  to  have  prior  ATC  experience  than  are 
nonminorities.  Based  on  the  above  information  related  to  experience  and  other 
existing  social  conditions,  women  and  minorities  have  not  been  represented  in 
ATC  to  the  extent  that  nonminority  men  have.  Civil  Aeromedical  Institute 
(CAMI)  records  during  1976  show  that  79  percent  of  ATC  trainees  who  entered 
the  FAA  Academy  were  nonminority  men,  while  women  and  minorities  combined 
comprised  the  remaining  21  percent. 

In  response  to  a need  for  more  minority  and  women  selectees  in  ATC,  the 
Predevelopmental  "150"  program  was  begun  in  1968.  This  1-year  program, 
conducted  primarily  at  field  facilities  includes  a 17-week  set  of  15  courses 
taught  at  the  FAA  Academy  related  to  basic  education,  aviation  principles,  and 
principles  of  air  traffic  control.  Onsite  orientation  is  also  provided.  The 
program  is  designed  to  compensate  for  deficiencies  in  the  backgrounds  of 
trainees  prior  to  their  entry  into  formal  air  traffic  control  training  at  the 
FAA  Academy.  Various  evaluations  of  the  "150"  program  in  the  past  have  been 
aimed  at  determining  if  the  selection  of  women  and  minorities  through  the 
"150"  program  resulted  in  a higher  percentage  of  women  and  minorities  in  ATC 
work  (8,9).  However,  there  has  not  been  an  explicit  study  to  determine  if  the 
training  received  in  the  "150"  program,  which  constitutes  a 1-year  agency 
investment  in  every  "150"  trainee,  has  indeed  produced  a direct  impact  on  the 
"150"  trainee's  ability  to  achieve  success  in  air  traffic  control.  Although 
no  measures  are  taken  to  determine  how  much  is  learned  through  onsite  orien- 
tation, tests  are  administered  during  the  17  weeks  of  Academy  training  and  the 
scores  are  recorded.  This  study  is  directed  toward  determining  the  unique 
relationship  between  predevelopment  training  scores  and  the  trainee's  ability 
to  achieve  success  in  FAA  Academy  training. 

II . Methods . 

Subjects.  The  sample  consisted  of  all  persons  wh."  came  through  the 
Predevelopmental  (FAA-150)  program  in  calendar  years  1974,  1975,  and  1976,  who 
finished  Academy  training  between  January  1976  and  March  1977,  and  for  whom 
CAMI  had  both  Predevelopmental  and  Academy  training  scores.  The  final  number 
of  persons  in  the  study  was  n =«  157. 

Variables  included  in  the  study.  Variables  are  listed  below  with  the 
abbreviated  form  to  be  used  in  this  report. 


Variable 

Code 

Abbreviat: 

1. 

Sex 

(1 

■ woman,  2 ■ man) 

SEX 

2. 

Minority  Status 

(1 

■ nonwhite,  2 ■ white) 

MINSTA 

3. 

Option 

(1 

■ Terminal,  2 ■ En  Routs) 

OPTION 

A. 

Education 

(1 

■ No  College,  2 ■ Some 
College,  3 ■ Degree) 

ED 

5. 

ATC  Experience 

(1 

-Yes,  2 - No) 

EXP 

civil  Service  Commission  Scores 


6. 

Part 

Score  2A  - Computations 

CSC2A 

7. 

Part 

Score  51  - Spatial  Patterns 

CSC51 

8. 

Part 

Score  5A0  - ATC  Aptitude  1 & II 

CSC5A0 

9. 

Part 

Score  157  - Letter  Sequence 

CSC157 

10. 

Part 

Score  135  - Oral  Directions 

CSC135 

11. 

CSC 

Composite  Score 

COMP 

12. 

CSC 

Earned  Rating  (includes  experience  and 

CSCER 

preference  points) 


Academy  Scores 


13.  Academy  Final  Phase  Score  2 
lA.  Academy  Final  Phase  Score  3 

15.  Academy  Final  Phase  Score  A 

16.  Total  Lab  Z-Score 

Predevelopmental  Program  Scores 


17. 

Coimunicat  ions 

COMM 

18. 

Social  Studies 

SOCSTU 

19. 

Human  Relations 

HUMREL 

20. 

Mathematics 

MATH 

21. 

Computations 

COMPUT 

22. 

Weather 

WEA 

23. 

Navigation 

NAV 

2A. 

Federal  Aviation  Regulations 

FAR 

25. 

Flight  Service  Station 

FSS 

26. 

Aerodynamics 

AERO 

27. 

Aircraft  Identification 

ACRTID 

28. 

National  Airspace  System 

NAS 

29. 

Air  Traffic  Control 

ATC 

30. 

Aviation  History 

AVNHIS 

31. 

Facility  Management 

FACMAN 

32. 

Average  for  Predevelopmental  Scores 

AVER 

Analyses.  The  first  stage  of  the  analyses  described  the  predevelop- 
ment aT~8ubJects  in  terms  of  their  background  characteristics,  i.e.,  sex, 


minority  status,  education,  experience;  scores  on  the  Civil  Service  Commission 
tests;  scores  on  tests  given  during  the  Predevelopmental  program;  and  scores 
made  on  the  lab  problems  during  Academy  training.  The  description  of  these 
characteristics  and  scores  were  in  the  form  of  means,  standard  deviations, 
and  sample  sizes  for  each  variable. 

The  second  stage  of  the  analyses  was  exploratory.  Initially,  how  all  of 
the  background  characteristics  and  scores  are  related  to  each  other  was 
explored  by  means  of  a correlation  index,  computed  by  pairing  all  the 
characteristics  and  scores.  Next,  a series  of  analyses  of  variance  were 
computed.  These  analyses  were  used  to  determine  if  the  predevelopraentals 
differed  on  their  scores  according  to  their  background  characteristics.  For 
example,  do  men  score  higher  than  women  on  the  Civil  Service  Commission  tests? 

The  last  step  in  exploration  involved  a statistical  look  at  the  pass/fail 
rates  in  Academy  training  by  each  of  the  background  characteristics  to  deter- 
mine, for  example,  if  women  fail  more  often  than  men.  Chi-Square  was  used  to 
test  for  differences.  In  all  cases,  statistical  significance  was  set  at 
a ■ .05  (or  better)  level  of  chance. 

In  the  last  step  of  the  analyses  all  the  exploratory  measures  were 
reviewed,  and  the  significant  measures  were  vised  to  develop  models  in  the  form 
of  path  diagrams  to  explain  the  unique  relationship  between  the  Predevelop- 
mental program  and  Academy  success. 

III.  Results . 

Descriptive  Statistics.  There  are  a few  items  to  note  in  relation  to  the 
descriptive  statistics  (Table  1).  First,  the  mean  scores  for  the  Predevelop- 
mental program  tests  are  quite  high,  generally  around  90  (out  of  a possible 
100)  with  an  overall  average  of  91.75.  Second,  the  Academy  scores  for 
predevelopmentals  are  low  for  all  training  phases  and  for  the  overall  ZLAR. 

(Note:  The  phase  and  ZLAB  scores  are  in  standard  score  form;  therefore,  a 
negative  score  means  it  is  that  many  standard  deviations  below  the  mean.) 

Another  item  related  to  the  Academy  scores  is  the  large  standard  deviations; 
there  was  a large  range  in  the  scores  for  Academy  training.  The  lowest  sample 
size  (n)  is  for  the  Civil  Service  Commission  scores  (about  50  percent  of  the 
total  sample).  Finally,  the  frequencies  in  the  data  (Tables  2-6)  are 
about  equal  for  sex,  minority  status,  and  option.  Notable  deviations  occur 
for  nonminority  men  and  for  minority  women,  both  of  whom  are  represented 
somewhat  less  than  their  counterparts. 

Exploratory  Statistics  (Table  7).  Correlations  between  the  following 
variables  were  selected  for  further  study  in  the  explanation  section.  They  by 
no  means  define  all  possible  meaningful  correlations  about  which  questions 
could  be  posed;  however,  they  do  appear  to  be  the  more  useful  ones.  The 
paired  variables  and  their  correlations  are:  (1)  SEX  - COMP  ■ 0.129, 

(2)  MINSTA  - COMP  - 0.118,  (3)  MINSTA  - ZLAB  - 0.239,  (4)  MINSTA  - AVER  - 
0.3A3,  (5)  OPTION  - AVER  - 0.225,  (6)  COMP  - ZLAB  - 0.161,  (7)  COMP  - AVER  - 
0.204,  and  (8)  ZLAB  - AVER  “ 0.464.  As  can  be  seen,  minority  status  cv^rrv'lates 
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TABLE  1. 

Descriptive  Statistics 
All  Variables. 

for 

Variable 

Mean 

JL. 

SEX 

1.48 

0.50 

157 

MINSTA 

1.46 

0.50 

157 

OPTION 

1.51 

0.50 

157 

CSC24 

46.11 

7.75 

83 

CSC  51 

57.65 

9.68 

79 

CSC 540 

37.81 

11.46 

80 

CSC157 

69.71 

15.18 

80 

CSC135 

27.13 

5.31 

78 

COMP 

79.45 

7.27 

88 

CSCER 

81.74 

7.82 

58 

PHI 

-0.85 

1.98 

153 

PH2 

-1.43 

2.43 

154 

PH3 

-1.08 

1.36 

154 

ZLAB 

-1.84 

2.40 

153 

COMM 

90.54 

5.04 

155 

SOCSTU 

90.58 

5.07 

36 

HUMREL 

86.48 

7.72 

23 

MATH 

91.79 

9.26 

155 

COMPUT 

92.31 

6.93 

154 

WEA 

92.33 

6.24 

155 

NAV 

92.06 

6.61 

155 

FAR 

93.50 

5.54 

155 

FAS 

92.58 

6.33 

155 

AERO 

95.04 

5.59 

155 

ACRTID 

89.21 

9.15 

155 

NAS 

94.24 

5.11 

153 

AIC 

90.21 

4.97 

155 

AVNHIS 

87.41 

5.52 

116 

FACMAN 

90.14 

6.29 

129 

AVER 

91.75 

4.08 

155 

ED 

1.93 

0.56 

98 

EXP 

1.73 

0.44 

98 

T«bl«  2.  Two-Uay  Fraquanclaf 
for  SEX  by  OPnON. 


Table  3.  Two-Way  Fraquencles 
for  SEX  by  MIMSTA. 


Table  4.  TWo-Hay  Fraquanclaa  for  MINSTA 
by  ED. 


Table  5.  TVo-Way  Frequencies  for 
MINSTA  by  EXP. 


Table  6.  Two-Way  Frequenclea 
for  MINSTA  by  OPTION. 


Nl'S  ' 


Ter 

Ed& 

XfiUl 

Malaa  : 

41 

41 

82 

FeaMlea  : 

36 

39 

75 

Total  : 

77 

80 

157 

Phi  - .02 

X'  - .063, 

df  - 1 

. P ■ 

ns 

X8X. 

Ink 

Total 

Nin  { 

50 

35 

85 

Non  Nin  : 

27 

45 

72 

Total  : 

77 

80 

157 

Phi  - .21 

X*  - 7.09, 

df  - 

1>  P < 

.01 

No 

No 

Inf. 

E»P- 

Exp.  Total 

Min  : 

35 

15 

35 

85 

Non  Min  : 

24 

11 

37 

72 

Total  : 

59 

26 

72 

157 

Phi  - .08 

x"  - .63, 

df  ■ 1, 

p ■ ns 

No 

No 

SoaM 

Inf. 

Coll 

Call 

Btta  XfiUL 

Min  : 

35 

10 

35 

5 

85 

Non  Min  : 

24 

9 

32 

7 

72 

Total  : 

59 

19 

67 

12 

157 

Phi  - .07 
X*  - .048, 

df  - 2 

> P " 

ns 

Mip 

Non 

XseaL 

Matea  : 59 

23 

62 

Females  : 26 

49 

75 

Total  : 85 

72 

157 

Phi  - .35 

X*  - 21.93,  df  - 

1,  p < .001 
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veil  with  AVER,  and  AVER  correlates  veil  with  ZLAB.  These  relationships 
will  be  of  particular  interest  in  explanation. 

The  next  set  of  exploratory  statistics  is  transitional  since  the  analyses 
edge  into  the  area  of  explanation.  These  consist  first  of  several  one-way 
analyses  of  variances.  These  analyses  determine  if  there  are  statistically 
significant  differences  in  (i)  Civil  Service  Coninission  composite  scores 
(COHP),  (ii)  Predevelopmental  program  total  average  scores  (AVER),  and  (iii) 
Academy  training  lab  (ZLAB)  totals  (three  dependent  measures),  based  on 
whether  the  subjects  are  (i)  men  or  women  (SEX),  (ii)  En  Route  or  Terminal 
(OPTION),  (iii)  minority  or  nonminority  (HINSTA),  and  on  (iv)  educational 
level  (ED),  and  (v)  ATC  experience  (EXP)  (five  independent  variables).  The 
following  differences  were  found  to  be  statistically  significant:  (1)  MINSTA 
for  ZLAB,  (2)  MINSTA  for  AVER,  and  (3)  OPTION  for  AVER.  Again  note  the  effect 
of  minority  status.  Results  of  analyses  of  variance  form  part  of  the  back- 
ground for  analytic  discussion  in  the  next  section. 

The  second  set  of  analyses  in  the  transitional  exploratory  area 
comprises  two-way  frequency  tables  (Tables  23-31).  These  tables  present  the 
Academy  pass/ fail  rates  by  sex,  minority  status,  option,  and  the  various 
combinations.  A Phi  coefficient  and  a Chi-Square  statistic  were  computed  for 
each  table  to  determine  if  there  was  a statistically  significant  difference  in 
the  pass/fail  rates  for  that  variable.  Pass/fail  races  found  significantly 
different  were:  (1)  MINSTA  for  pass/fail,  (2)  MINSTA  (men  only)  for  pass/ 
fail,  and  (3)  MINSTA  (En  Route  only)  for  pass/fail.  This  third  set  of 
exploratory  statistics  again  emphasizes  minority  status. 

Explanatory  Statistics.  The  exploratory  statistics  presented  above  are 
relatively  stright forward  computations  that  offer  insight  in  terms  of  rela- 
tionships or  differences;  however,  they  are  inadequate  (although  they  are 
often  so  used  incorrectly)  to  directly  explain  or  to  infer  causality  for 
controlling  effects.  What  is  needed  is  a way  to  consider  the  relationships 
between  variables  simultaneously  and  to  consider  the  unique  contribution  of 
each  of  the  independent  variables  to  the  dependent  variable  of  interest.  This 
can  be  done  by  constructing  path  diagram  models  and  using  correlations  to 
perform  a series  of  multiple  linear  regressions  to  determine  the  path 
coefficients  (Betas).  Given  proper  assumptions,  the  coefficients  can  then  be 
interpreted  as  the  unique  contribution  of  each  path  in  explaining  variance  in 
the  dependent  variable  (5).  The  correlations  presented  above  revealed  some 
interesting  relationships  that  can  be  used  to  develop  path  diagrams. 

The  first  diagram  relates  to  the  following  questions:  If  the  CSC  COMP 
scores  represent  a measure  of  the  ability  of  predevelopmentals  to  achieve 
Academy  success  prior  to  predevelopmental  training,  how  much  does  predevelop- 
mental training  add  to  their  ability  to  achieve  Academy  success?  After 
partialling  out  the  trainee's  ability  level  prior  t^  predevelopmental  training, 
how  much  does  predevelopmental  training  contribute  to  Academy  success?  The 
questions  can  be  expressed  in  the  model  presented  in  Figure  1. 
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TAALE  8.  Malysls  of  Variance:  Sex  Effect  for  CSC 
Composite. 


Mean  S .D. 

82.18 

8.40 

81.33 

7.35 

SS 

di 

MS 

F 

BaCwaan  Groups  : 

10.31 

1 

10.31 

0.17  ns 

Within  Groups  : 

3472.78 

56 

62.01 

Total  : 

3483.09 

57 

Laval  of  significance  is  indicated  by  ns  (nonsignif- 
icant), * (p  ■ .05),  **  (p  ■ .005),  and  (p  - .001). 


TABLE  9.  Analysis  of  Variance:  Education  Effect  for 
CSC  Composite. 


_il 

Mean 

S.D. 

No  Coll  : 

6 

82.50 

6.98 

Soma  Coll  : 

26 

82.04 

6.09 

Degree  : 

3 

85.33 

12.34 

Source 

SS 

di 

MS 

F 

Between  Groups  : 

29.27 

2 

14.63 

0.32  ns 

Within  Groups  : 

1475.14 

32 

46.10 

Total  : 

1504.41 

34 

Laval  of  significance  is  indicated  by  ns  (nonsignif- 
icant), * (p  “ .05),  **  (P  “ .005),  and  ***  (p  - .001). 


TABLE  10.  Analysis  of  Variance:  Experience  Effect  for 
CSC  Composite. 


Jl 

JlBia  S.D. 

Exp.  : 11 

84.00 

5.22 

No  Bxp.  : 24 

81.67 

7.20 

Source 

SS 

dl 

MS 

F 

Between  Groups  : 

41.08 

1 

41.08 

0.93  ns 

Total  : 

1504.41 

34 

Laval  of  significance  is  indicated  by  ns  (nonsignif- 
icant), * (p  “ .05),  **  (p  ■ .005),  and  ***  (p  ■ .001). 
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TABLE  11.  Analysis  ot  Variance:  Minority  Efiect  tor 
CSC  Composite. 


Ji 

Kean 

■S»Bla 

Min.  : 

29 

80.03 

7.18 

Nonmin . : 

29 

83.45 

8.17 

Source 

SS 

sli 

MS 

r 

Between  Groups  : 

168.97 

1 

168.97 

2.86  ns 

Total  : 

3483.09 

57 

L«v«l  of  significance  is  indicated  by  ns  (nonsignif- 
icant), * (p  • .05),  **  (p  • .005),  and  ***  (p  - .001). 


TABLE  12.  Analysis  of  Variance:  Option  Effect  for  CSC 

Composite. 


Jl 

Terminal  : 28 

KnRoute  : 30 

Mean  S.D. 
81.00  8.46 
82.43  7.24 

Source 

SS  di 

MS 

F 

Between  Groups  : 

Total  : 

29.75  1 

3483.09  57 

29,75 

0.48  ns 

Level  of  significance  is  indicated  by  ns 
leant),  * (p  ■ .05),  **  (p  • .005),  and  *** 

(nonsignif- 
(p  - .001). 

TABLE  13.  Malysis  of  Variance: 

Sex  Effect  for  ZLAB. 

_i! 

Males  : 81 

Females  : 72 

Mean  S .0. 

-1.78  2.53 

-1.91  2.25 

Source 

SS  df 

MS 

F 

Between  Groups  : 

Total  : 

0.70  1 

872.19  152 

0.70 

0.12  ns 

Level  of  significance  is  Indicated  by  ns  (nonsignif- 
icant), * (p  - .05),  **  (p  • .005),  and  (p  - .001). 


r 


TABLE  14.  An«lysla  of  Variance:  Experience  Effect  for 


ZLAB. 

J! 

Exp.  : 26 

No  Exp.  : 69 

Mean  S Jl. 

-2.29  2.43 
-2.09  2.79 

Source 

$S  df 

HS 

F 

Between  Groups  : 

Total  : 

0.71  1 

677.13  94 

0.71 

0.10  ns 

Level  of  significance  is  indicated  by  ns 
leant),  * (p  ■ .05),  **  (p  - .005),  and  *** 

(nonsignlf- 
(p  - .001). 

TABLE  15.  Analysis  of  Variance: 

ZLAB. 

Minority  Effect  for 

-H 

Min.  ; 83 

Nonmin.  : 70 

Mean  S .0. 
-2.37  2.57 
-1.22  2.01 

Source 

SS  df 

MS 

F 

Between  Groups  : 

Total  : 

49.98  1 

872.19  152 

49.98 

9.18  ** 

Level  of  significance  is  indicated  by  ns 
leant),  * (p  ■ .05),  **  (p  ■ .005),  and  *** 

(nonslgnif- 
(p  - .001). 

TABLE  16.  Analysis 

of  Variance:  Option  Effect  for  ZLAB 

Tentlnal  : 7^ 

BnEoute  : 76 

-ttfiBa  S.D. 

^TT67  1T9I 

-2.01  2.81 

Source 

SS  d£ 

MS 

F 

Between  Groups  : 

Total  : 

4.49  1 

872.19  152 

4.49 

0.78  ns 

Level  of  significance  is  indicated  by  ns  (nonsignif- 
icant), * (p  ■ *05),  **  (p  ■ .005),  and  ***  (p  - .001). 
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TABLE  17.  Analysis  of  Variance:  Education  Effect  for 

ZLAB. 


-H 

Mean 

S.D. 

No  Coll  : 17 

-2.26 

2.84 

Some  Coll  : 66 

-2.32 

2.77 

Degree  : 12 

-1.02 

1.76 

Source 

SS 

-iLfc 

MS 

r 

Between  Groups  : 

17.36 

2 

8.68 

1.21  ns 

Total  : 

677.13  94 

Level  of  significance  is  indicated  by  ns  (nonsignif- 
icant), * (p  ■ .05),  **  (p  ■ .005),  and  ***  (p  ■ .001). 


TABLE  18.  Analysis  of  Variance:  Sex  Effect  for  Pre 
developmental  Total  Average. 


Ji 

Mean 

S.D. 

Males  : 81 

91.79 

3.77 

Females  : 74 

91.70 

4.43 

Source 

SS 

df 

MS 

F 

Between  Groups  : 

0.25 

1 

0.25 

0.01  ns 

Total  : 

2569.13 

154 

Level  of  significance  is 

Indicated  by  ns 

(nonslgnlf- 

icant),  * (p  • . 

05),  **  (p  , 

■ .005) 

f And 

(p  - .001). 

TABLE  19.  Analysis  of  Variance: 

Education 

Effect  for 

Predevelopmental  Total 

Average. 

Jl 

Mean  S.D. 

No  Coll  : 19 

90.79 

4.92 

Some  Coll  : 66 

91.65 

4.06 

Degree  : 12 

93.83 

2.76 

Source 

SS 

MS 

F 

Between  Groups  : 

70.25 

2 

35.13 

2.08  ns 

Total  : 

1658.06 

96 

Uvel  of  significance  is  indicated  by  ns  (nonsignif- 
icant), * (p  - .05),  *★  (p  - .005),  and  ♦**  (p  - .001). 


[ 
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TABLE  20.  Analysis  of  Variance:  Experience  Effect  for 
Predevelopmencal  Total  Average. 


Ji 

Exp.  : 25 

No  Exp.  : 72 


Between  Groups  : 

Total  : 


92.76  3.96 

91.40  4.19 


34.19 

1658.06 


MS 

34.19 


2.00  ns 


Level  of  significance  is  indicated  by  ns  (nonsignif- 
icant), * (p  - .05),  **  (p  - .005),  and  (p  - .ool) . 


TABLE  21.  Analysis  of  Variance:  Minority  Effect  for 
Predevelopaental  Total  Average. 


Mean 

Min.  : 

84 

90.46 

4.20 

Nonmln . : 

71 

93.27 

3.39 

Between  Groups 
Total 


302.38 

2569.13 


-Jil  MS 
1 302.38 

154 


20.41  *** 


Level  of  significance  is  indicated  by  ns  (nonsignif- 
icant), * (p  - .05),  **  (p  - .005),  and  ***  (p  - .001). 

TABLE  22.  Analysis  of  Variance:  Option  Effect  for  Pre- 
developmental  Total  Average. 

Mean  S.D. 

Tenslnal  : 76  90.82  4.48 
EnRoute  : 79  92.65  3.46 


Between  Groups  : 129.63  1 129.63  8.13  ** 

Total  : 2569.13  154 

Level  of  sipilficance  is  indicated  by  ns  (nonsignif- 
icant), * (p  - .05),  **  (p  - .005),  and  ***  (p  - .001). 


TABLE  23.  Two-Way  Fraquancy  Oiatributlon  for  Pra 
davalopawntala  (Total  Group)  by  Sox. 


n 


! t 


la  Fall 

iBtBl 

Malaa  : 

~54 

40V  19 

13% 

73  53% 

Famalea  : 

49 

35%  15 

12% 

64  47% 

Total  : 

103 

75%  34 

25% 

137**100% 

Phi  - .0299 

Chi-Square  ~ .123 

df  - 1 

P “ 

ns 

*Proportloaa  or  probabllltlaa  baaad  on  total  aaapla. 
**0ao  withdrawal  (naloi  nonwlnorltyt  BnRouta) . 


TABLE  24.  Two-Way  Frequency  Oiatributlon  for  Pre- 
davolopnantala  (Total  Group)  by  Minority  Statue. 


Pi 

tss 

Min.  : 

51 

27 

20% 

78  57% 

Monadn. 

52 

38% 

7 

5% 

59  43% 

Total  : 

103 

75% 

34 

25% 

137**100% 

Phi  - .2524 
Chi-Square  ■ 9.319 


df 


p a .01 


*Proportloaa  or  probabllltlaa  baaad  on  total  aoMple. 
**0na  withdrawal  (atale,  nonalnorltyt  EnKoute). 


TABLE  25.  Two-Way  Frequency  Oiatributlon  for  Fre- 
davolopaMntala  (Total  Group)  ^ Option. 


Paaa 

Fall 

Terminal  : 

52  38%* 

20 

15% 

72  53% 

EnRouta  : 

51  37% 

14 

10% 

65  47% 

Total  : 

103  75% 

34 

25% 

137**100% 

Phi  - .0719 
Chl-Squara  ■ 

• .7127 

df  - 1 

P 

■ ns 

*Froportlona  or  probabllltlaa  baaad  on  total  aaapla. 
**Dne  withdrawal  (wale,  noraalnorlty«  BnBouta) . 
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TABLE  26.  Two-Way  Fraquancy  Dlatributlon  for  Fro* 
davolopnantala  (Famalo)  by  Minority  Statua. 


Min.  : 

IS 

23X* 

8 

13X 

23 

36X 

Monaln.  : 

34 

52X 

7 

12X 

41 

64X 

Total  : 

49 

75X 

15 

2SX 

64**100X 

Phi  - .1957 

Chi*Squaro  ■ 

2.: 

5752 

df  - 1 

P 

• na 

^Proporciona  or  prdbabllltlat  baaad  on  total  aaapla. 
**Oam  withdrawal  (wala,  nonalnorltyt  BnRouta) . 


TABLE  27.  TWo-Way  Fraquancy  Dlatributlon  for  Pra* 
davalopnantala  (FomIo)  by  Option. 


25 

39X* 

9 

14X 

34 

S3X 

24 

38X 

6 

9X 

30 

47X 

49 

77X 

IS 

23X 

1 

lOOX 

Phi  - .076 

Chl'Squara  ■ .3719  df  ■ 1 p ■ na 

*Proportlaaa  or  probabllltloa  baaad  on  total  aMpla. 
^Ona  withdrawal  (auila,  nonalnorityt  EnRouto). 


TABLE  2S.  Two*Way  Froquancy  Dlatributlon  for  Pra* 
davalopaantala  (Mala)  by  Minority  Statua. 


Min.  : 

36 

49X* 

19  26X 

55  75X 

Nonala. 

18 

2SX 

0 OX 

18  2SX 

Total  : 

54 

74X 

19  26X 

73»«100X 

Phi  - .3213 

Chl'Squara  ■ 

8.< 

ft061 

df  * 1 pa 

.01 

*Proportlona  or  probabllltloa  baaad  on  total  aaapla. 
^Ono  withdrawal  (aukla,  noraalnorlty,  biBouto) . 


TABLE  29.  Two-Way  Frequency  DlaCrlbutlon  for  Pre- 
developeMntals  (Male)  by  Option. 


Paas^ 

Fell 

Total 

Terminal  : 

27 

371* 

11 

15X 

38  52X 

EnRoute  : 

27 

37t 

8 

IIX 

3 5 48X 

Total  : 

54 

74X 

19 

26X 

73**100X 

Phi  - .0692 

Chi-Square  ■ 

.3510 

df  - 1 

P 

• ns 

proportions  or  probabilities  based  on  total  sasw>le. 
One  withdrawal  (nale,  nomslnorlty,  EnRoute) . 


TABLE  30.  Two-Way  Frequency  Distribution  for  Pre- 
developmntals  (EnRoute)  by  Minority  Status. 


Pass 

Fall 

Total 

Min.  : 

19 

29X* 

12  18X 

31  47X 

Monmln. 

32 

49X 

2 4X 

34  53X 

Total  : 

51 

78X 

14  22X 

65**100X 

Phi  - .3705 
Chi-Square  ■ 

10.3401 

df  - 1 

p i .01 

Proportions  or  probabilities  based  on  total  sample. 
**0na  withdrawal  (suila,  nonminority,  EnRoute) . 


TABLE  31.  IWo-Way  Frequency  Distribution  for  Pre- 
davolopmantals  (Terminal)  by  Minority  Status. 


Fall 

Total 

Min.  : 32  44X'* 

15  21X 

47  65X 

Mocaln.  i 20  28X 

5 7X 

25  35X 

Total  t 52  72X 

20  28X 

72**100X 

Phi  - .1256 

Chl-Squaro  - 1.1548 

df  - 1 p 

■ ns 

^roportloas  or  probabilities  based  on  total  sample. 
**0na  withdrawal  (male,  nonmlnorlty,  EnRoute). 
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Figure  1.  Path  diagram  for  Model  I (without  path 

coefficients).  Effect  of  Predevelopmental 
training  on  Academy  success. 


Regressing  ZLAB  on  CSC  COMP  and  predevelopmental  AVER  produces  the 
relationships  depicted  in  Figure  2. 


.204 


Figure  2.  Path  diagram  for  Model  I (with  path 

coefficients).  Effect  of  Predevelopmental 
training  on  Academy  success. 

Clearly,  the  predevelopmental  AVER  adds  a large  amount  of  explanatory  power 
relative  to  what  CSC  COMP  does  in  explaining  ZLAB  scores.  To  determine  how 
well  the  model  represents  the  data,  the  original  correlation  matrix  was 
reproduced  by  using  the  path  coefficients.  The  coefficients  above  the 
diagonal  are  the  original  correlations;  the  coefficients  below  the  diagonal 
are  the  reproduced  correlations.  As  viewed  from  Table  32,  the  model  represents 
the  data  very  closely.  This  evidence  supports  the  belief  that  the  Predevelop- 
mental program  adds  significantly  to  the  trainee's  ability  to  achieve  success 
in  the  Academy  program. 

Building  on  the  existing  model,  is  there  another  variable  chronologically 
preceding  CSC  COMP  that  might  provide  useful  information?  An  obvious  one  that 
consistently  showed  up  in  the  exploratory  analyses  was  minority  status,  and 
another  variable  preceding  CSC  COMP  chronologically  is  sex.  So,  another 
question  can  be  posed:  Does  the  relationship  between  the  Predevelopmental 
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TABLE  32.  Efficiency  Table  for  Model  I. 


CSC 

Aver 

ZLab 

CSC 

1.000 

.204 

.161 

Aver 

.204 

1.000 

.464 

ZLab 

.156 

.436 

1.000 

Correlations  above  the  diagonal  are 
original;  those  below  the  diagonal  are 
reproduced  from  path  coefficients . 


program  and  the  ability  to  achieve  Academy  success  differ  according  to  minority 
status  or  sex?  First,  minority  status  is  introduced  into  the  model.  To  test 
this  model,  scores  were  regressed  directly  on  MINSTA,  CSC  COMP,  and  AVER 

to  determine  direct  relationships,  and  then  AVER  was  regressed  on  MINSTA  and 
CSC  COMP  to  determine  indirect  relationships.  The  results  are  presented  in 
Figure  3. 


Figure  3.  Path  diagram  for  Model  II.  The  influence  of 
minority  status  on  the  effect  of  predevelop- 
mental  training  on  Academy  success. 

The  model  in  Figure  3 demonstrates  a mild  direct  contribution  (.0841)  of 
CSC  COMP  (the  measure  used  to  represent  the  ability  to  achieve  Academy  success 
prior  to  the  predevelopmental  training)  and  minority  status  (.0941)  on  ZLAB 
scores  (Acaden^  success).  However,  there  is  a strong  direct  contribution 
(.3864)  of  AVER  (the  Predevelopmental  program  effect)  on  ZLAB.  Now,  we  can 
proceed  to  observe  indirect  paths. 

There  are  two  dominant  indirect  routes  to  ZLAB: 

(1)  MINSTA  — > CSC  COMP  — > AVER  — > ZLAB,  and 

(2)  MINSTA  — > AVER  — > ZLAB. 
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Clearly,  the  second  route  |See  Figure  3)  is  superior  to  the  first. 

Essenti&lly , this  model  demonstrates  that  minority  status  makes  little 
direct  contribution  to  Zl^  (Academy  success)  for  predevelopmentals , but  when 
channeled  through  AVER  (the  Predevelopmental  program),  minority  status  makes 
a strong  indirect  contribution  to  Academy  success.  The  evidence  supports  the 
idea  that  the  Predevelopmental  program  produces  a differential  contribution 
in  terms  of  the  trainee's  ability  to  achieve  Academy  success  according  to 
the  trainee's  minority  status. 

Again,  the  efficiency  of  the  model  can  be  observed  by  the  reproduced 
correlation  matrix  in  Table  33,  and  the  fit  is  very  close. 


TABLE  33.  Efficiency  Table  for  Model  II. 


Min 

CSC 

Aver 

23.ab 

Min 

1.000 

.118 

.343 

.239 

CSC 

.118 

1.000 

.204 

.161 

Aver 

.341 

.204 

1.000 

.464 

ZLab 

.237 

.160 

.436 

1.000 

Correlations  above  the  diagonal  are 
original;  those  below  the  diagonal  are 
reproduced  from  path  coefficients . 


Are  there  rival  hypotheses  that  could  account  for  this  differential 
contribution  by  minority  status?  One  possibility  is  that  the  predevelop- 
mentals differed  in  ability  by  minority  status  prior  to  entering  the 
Predevelopmental  program.  However,  there  is  no  significant  difference 
(Table  11)  in  CSC  COMP  (the  measure  used  to  represent  prior  ability)  by 
minority  status.  Another  possibility:  the  difference  is  due  to  differences 
in  educational  level  or  experience  level,  rather  than  minority  status. 

Again,  there  are  no  significant  differences  by  educational  level  or  experience 
level  on  either  AVER  or  ZLAB  (Tables  14,17,19,20),  and  Tables  4 and  5 show 
education  and  experience  do  not  differ  by  minority  status.  Still  another 
possibility  involves  sex  differences.  But  Table  8 shows  no  significant  sex 
differences.  For  illustrative  purposes  sex  was  introduced  into  the  model  in 
place  of  minority  status  to  demonstrate  the  difference  from  the  minority  model 
(Figure  4).  As  viewed  from  the  model,  sex  makes  little  to  no  direct  contri- 
bution (-.033)  or  indirect  contribution  (.0156)  through  AVER  on  ZLAB  scores. 

It  makes  a mild  indirect  contribution  through  CSC  COMP  scores  (.129). 
Comparison  of  the  "above"  and  "below"  diagonals  on  the  reproduced  correlation 
matrix  in  Table  34  demonstrates  a close  fit. 

The  exploratory  statistics  selected  for  analyses  do  not  suggest  any 
further  model  testing.  The  following  three  statements  summarize  the  results 
of  the  model  testing. 
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Figure  4.  Path  diagram  for  Model  III.  The  influence 


of  sex  on  the  effect  of  Predevelopmental 
training  on  Academy  success. 


TABLE  34.  Efficiency  Table  for  Model  111. 


Sex 

CSC 

Aver 

ZLab 

Sex 

1.000 

.129 

-.011 

-.028 

CSC 

.129 

1.000 

.204 

.161 

▲ver 

-.008 

.191 

1*000 

.464 

ZLab 

-.026 

.154 

.436 

1.000 

Correlations  above  the  diagonal  are 
original;  those  below  the  diagonal  are 
reproduced  from  path  coefficients. 


I (1)  Model  I indicates  that  the  Predevelopmental  program  (as  measured  by 

AVER)  makes  a significant  addition  to  the  trainee's  ability  to  achieve  success 
\ in  the  Academy  (as  measured  by  ZLAB)  beyond  his  ability  to  achieve  success  in 

the  Academy  program  prior  to  predevelopmental  training  (as  measured  by  CSC 
COMP). 

• (2)  Model  II  suggests  that  the  contributions  of  the  Predevelopmental 

program  to  the  trainee's  ability  to  achieve  success  in  the  Academy  is 
) differential  according  to  minority  status. 

(3)  Model  III  does  not  demonstrate  a differential  contribution  by  sex  of 
^ the  Predevelopmental  program  on  the  trainee's  ability  to  achieve  Academy 

I'.  success. 


IV.  Discussion  of  Results. 


Model  I indicates  that  the  P re developmental  program,  overall,  aids  the 
disadvantaged  to  achieve  success  in  the  FAA  Academy.  This  is  an  important 
finding,  since  it  indicates  support  for  the  accomplishment  of  one  of  the 
primary  goals  of  the  program.  Past  studies  (8,9)  concluded  that  the  Prede- 
velopmental  program  was  responsible  for  an  increase  in  the  number  of  disad- 
vantaged persons  in  air  traffic  control,  and  these  studies  support  the  notion 
of  a unique  relationship  between  Academy  success  and  the  training  they 
received  in  their  Predevelopmental  program.  However,  it  should  be  pointed  out 
concurrent  with  these  statements  about  Model  I,  that  this  study  is  not 
designed  to  determine  cost-effectiveness.  Whether  the  benefit  received  from 
the  program  is  worth  the  investment  is  another  matter. 

The  implications  of  Model  II  are  more  difficult  to  assess.  The  tentative 
evidence  of  Model  II  supports  the  idea  that  nonminorities  were  aided  by  the 
program,  but  the  extent  of  aid  to  minorities  appears  open  to  question. 

Several  rival  hypotheses  were  considered  and  rejected  as  explanations  for  this 
differential  by  minority  status,  viz  initial  ability  (CSC  scores),  prior  ATC 
experience,  and  educational  level.  The  three  major  ability  measurements,  CSC 
COMP,  AVER,  and  ZLAB,  viewed  independently  by  minority  status  suggests  the 
possibility  of  another  rival  hypothesis.  Tables  21,  15,  and  11  show  a 
significant  difference  by  minority  status  for  AVER  and  ZLAB;  however,  no 
significant  difference  is  found  in  CSC  scores  by  minority  status. 

This  circumstance  could  obviously  be  due  to  several  factors  related  to  CSC 
scores.  Since  we  had  no  quantitative  data  on  CSC  selection  and  testing 
procedures,  direct  contacts  were  made  with  the  personnel  in  charge  of  CSC 
testing  at  FAA  regional  offices.  Interviews  with  those  persons  yielded  infor- 
mation that  the  Predevelopmental  testing  procedures  included  retesting  those 
who  scored  below  the  cutoff  point;  a second  or  possibly  a third  testing  might 
be  allowed,  sometimes  with  specially  related  remedial  instruction  given 
between  the  testing  sessions.  What  effect  might  this  situation  have  on  the 
models? 

Consider  that  observed  test  scores  (Oi)  consist  of  the  true  ability  score 
(Tj^)  on  that  test  and  any  error  (Ei)  involved  in  the  measurement  process. 

Oi  - Ti  + Ei  (1) 

Repetitive  testing  of  a group  taking  the  higher  scores  on  the  average 
results  in  higher  observed  scores  by  adding  to  the  error  component.  Conse- 
quently, scores  inflated  by  the  addition  of  error  yield  misleading  estimates 
of  potential  success,  since  the  observed  scores  are  inaccurate  estimates  of 
the  group's  ability.  Since  retesting  occurs  predominantly  for  the  group  who 
score  below  the  cutoff,  the  inflation  of  scores  would  occur  predominantly  at 
the  lower  end  of  the  score  continuum. 

The  effect  of  such  a retesting  procedure  on  Model  I would  not  alter  the 
conclusion  based  on  that  model,  since  a higher  ability  level  based  on  CSC 
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scores  would  be  partialled  out  of  ZLAB  scores  prior  to  determining  the 
contribution  of  the  Predevelopmental  program  to  what  is  left  over  in  ZLAB 
after  the  partialling-out  process.  In  this  case  (retesting),  Model  I would  be 
a conservative  estimate  of  the  overall  effect  of  Predevelopmental  training  on 
Academy  success. 

In  terms  of  Model  II,  the  results  of  a retesting  procedure  are  quite 
different.  It  could  well  be  that  Chose  retaking  the  CSC  battery  are  in  the 
minority  status  category.  Retest  scores  would  inflate  the  estimate  of  their 
ability  and  give  the  appearance  of  equal  initial  ability  levels  for  minorities 
and  nonminorities,  when  in  fact  their  initial  ability  levels  are  quite 
different.  This  could  account  for  the  differential  contributions  by  minority 
status  in  Model  II.  Likewise,  it  could  account  for  the  significant  differences 
in  Predevelopmental  and  ZLAB  scores  by  minority  status. 

At  present,  data  are  not  available  on  the  selection  process  (in 
particular,  CSC  testing)  so  that  determinations  could  be  made  of  the  effects 
of  the  selection  procedures.  However,  it  would  appear  economically  and 
socially  advantageous  to  perform  such  a study.  First,  suppose  the  predevelop- 
mental failures  at  the  Academy  are  primarily  those  who  retook  the  CSC  battery 
in  order  to  score  above  the  cutoff  point.  Use  of  the  retesting  procedure 
would  not  have  gained  the  agency  more  minorities  in  ATC,  rather  the  agency 
would  have  expended  considerable  resources  only  to  fail  them  at  the  Academy, 
when  those  failing  trainees  could  have  been  selected  out  initially.  Second, 
such  a study  would  help  determine  if  a real  differential  does  exist  by 
minority  status  in  the  contribution  predevelopmental  training  makes  to  Academy 
success.  If  in  fact  there  is  such  a differential,  the  Predevelopmental 
training  program  should  be  assessed  and  redirected  toward  achieving  the  goal 
of  enhancing  the  chances  of  minorities  and  women  to  be  successful  air  traffic 
controllers . 

There  are  at  least  four  elements  of  this  report  that  should  be  noted  prior 
to  generalizing  the  findings: 

(i)  Although  the  reported  sample  of  trainees  represents  3 years  of 
students  in  the  Predevelopmental  program  who  have  gone  through  Academy 
training  between  January  1976  and  March  1977,  the  sample  size  is  not  ideal. 
Thus,  the  inferences  drawn  should  be  interpreted  with  some  caution. 

(ii)  The  second  consideration  is  related  to  the  first.  In  order  to 
investigate  the  stability  of  the  models,  a cross-validation  study  should  be 
performed  as  soon  as  more  trainee  data  are  available. 

(iii)  Causal  models  never  prove  causality  (neither  does  any  other 
statistical  technique).  Evidence  is  gathered  which  either  supports  or  denies 
a proposition.  The  more  evidence,  the  more  sure  the  conclusions.  Causal 
models  such  as  path  analysis  offer  evidence  to  infer  causality. 
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(iv)  Reliability  and  validity  of  measurement  instruments: 

a.  Reliability. 

1.  CSC  scores.  A search  through  the  available  literature  yielded 
no  reliability  information  regarding  these  scores.  A report  by  Mies  (7) 
stated  that  such  information  was  in  an  earlier  report  (4)  by  Education  and 
Public  Affairs,  Inc.  However,  a close  examination  of  the  latter  revealed  no 
reliability  data.  It  is  perhaps  safe  to  assume  that  the  CSC  has  sufficient 
reliability  information  for  the  test  to  be  in  use. 

2.  ZLAB  scores.  Reliabilities  were  computed  on  ZLAB  scores  at  CAMI 
for  each  input  in  1976.  The  average  of  these  coefficients  (converting  r's  to 
Fisher's  Z)  was  .73. 

3.  Predevelopmental  scores.  Reliability  information  was  not  avail- 
able on  predevelopmental  scores;  however,  the  average  intercorrelation  of  the 
subscores  (again,  converting  r's  to  Fisher's  Z)  was  .44.  This  could  be  taken 
as  an  indication  of  the  consistency  of  the  measures. 

b.  Validity. 

1.  CSC  scores.  The  1970  Education  and  Public  Affairs  report  (4) 
contains  a thorough  listing  of  validity  studies  on  the  CSC  scores.  The  details 
of  those  studies  will  not  be  presented  here,  but  the  results  were  conflicting 
and  inconclusive. 

2.  and  3.  ZLAB  and  Predevelopmental  scores.  At  present  a field 
criterion  has  not  been  sufficiently  developed  for  such  a study.  The  intercor- 
relation between  ZLAB  and  AVER  is  .464.  This  could  be  used  as  a coefficient 
of  validity  for  predevelopmental  scores. 


Summary 


1.  The  results  of  this  study  indicate  that  Predevelopmental  training, 
overall,  enhances  the  predevelopmental ' s chances  for  success  in  ATC  training  at 
the  FAA  Academy.  With  this  statement  one  is  cautioned  not  to  assume  the 
program  is  particularly  cost-effective  or  that  the  program  could  not  be 
improved. 

2.  The  study  suggests  further  that  the  contributions  of  Predevelopmental 
training  to  Academy  success  could  be  differential  according  to  minority 
status;  however,  this  differential  may  be  rooted  in  the  procedures  used  for 
selection  into  the  Predevelopmental  program  (particularly  CSC  retesting). 


3.  This  study  also  demonstrates  the  need  for  a study  into  the  selection 
procedures  for  the  Predevelopmental  program.  Such  a study  could  have  both 
economic  and  social  advantages. 
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